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What is claimed is: 

CLAIMS 



A method for triggering haptic sensations from sound features detected in sound 
output frdin a computer, said haptic sensations able to be delivered to a user of a haptic feedback 
device in coHtfnunication with said computer, the method comprising: 

storing \ portion of sound data that is output to a user as audio from an application 
program runningVn said computer, wherein said portion of sound data is stored in a memory 
buffer of said computer; 

analyzing saidV>ortion of sound data using intelligent heuristics to extract at least one 
sound feature from said\ortion of sound data; and 

triggering the execution of at least one haptic effect based on said at least one sound 
feature, wherein said at least one haptic effect is commanded to said haptic feedback device 
approximately correlated to sani output of said portion of sound data to said user as audio, said 
haptic effect causing a haptic sensation to be output to said user. 

2. A method as recited in claim, 1 wherein said analyzing said portion of said sound data 
includes processing said sound data into\ plurality of different frequency ranges and extracting 
said sound feature from each of said frequency ranges. 

3. A method as recited in claim 2 whetein a haptic effect is associated with each of said 
frequency ranges if said sound feature is present tn said frequency range. 

4. A method as recited in claim 2 wherein sirid processing said sound data into a plurality 
of different frequency ranges includes applying a plurality of filters to said portion of sound data. 

5. A method as recited in claim 4 wherein at lea^ one low-pass filter, at least one high- 
pass filter, and at least one bandpass filter is applied to sard portion of sound data to provide at 
least three frequency ranges. \ 

6. A method as recited in claim 2 wherein said processing^said sound data into a plurality 
of different frequency ranges includes using a fast Fourier transfornWFFT). 
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V7. A method as recited in claim 6 wherein a number of outputs from said fast Fourier 
transform are grouped to provide each of said frequency ranges. 

8. \ method as recited in claim 4 wherein each of said frequency ranges is associated 
with a differen^haptic sensation. 

9. A metftod as recited in claim 8 wherein each of said frequency ranges is associated 
with a periodic hapt\c sensation having a different frequency. 

10. A method recited in claim 1 wherein said at least one haptic effect triggered by 
said at least one sound feature was previously mapped to said at least one sound feature. 



11. A method for presiding haptic effects based on sound data played by a computer, 
said haptic effects able to be outout as haptic sensations to a user of a haptic feedback device in 
communication with said computer, the method comprising: 

storing a portion of said souhd data that is output from an application program running on 
said computer, wherein said portion of sound data is stored in a memory buffer of said computer; 

analyzing said portion of sound data using intelligent heuristics to extract at least one 
high-level sound feature from said portion of sound data, wherein said at least one high-level 
sound feature in said portion of sound date has been associated with at least one high-level haptic 
effect; and \ 

commanding said associated at least one haptic effect to be output approximately when 
said associated sound feature is played by said application program. 



12. A method as recited in claim 11 wherem said analyzing said portion of said sound 
data includes processing said sound data into a plurality of different frequency ranges and 
extracting said sound feature from each of said frequency ranges. 

13. A method as recited in claim 12 wherein a hWic effect is associated with each of 
said frequency ranges having said sound feature. \ 

14. A method as recited in claim 12 wherein said processing said sound data into a 
plurality of different frequency ranges includes applying a plurality of filters to said portion of 
sound data. \ 
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IX A method as recited in claim 12 wherein said processing said sound data into a 
plurality oMifferent frequency ranges includes using a fast Fourier transform (FFT). 

16. AWethod as recited in claim 15 wherein a number of outputs from said fast Fourier 
transform are grouped to provide each of said frequency ranges. 

17. A metHod as recited in claim 13 wherein each of said frequency ranges is associated 
with a different haptrc effect. 

18. A methodVs recited in claim 17 wherein each of said frequency ranges is associated 
with a periodic haptic effect having a different frequency. 

19. A method as recited in claim 1 1 wherein said commanded at least one haptic effect is 
output as a haptic sensation tb said user by said haptic feedback device. 

20. A method as recited in claim 1 1 wherein said commanded haptic effect is not output 
to said user but is stored in memory of said computer as a created haptic effect. 

21. A computer readable medium including program instructions for providing haptic 
sensations correlated with sound output from a computer to a user of a haptic feedback device in 
communication with said computer, the program instructions performing steps comprising: 

storing a portion of sound data that is to be output to a user as audio from an application 
program running on said computer, wherein said sound data is stored in a memory buffer of said 
computer; \ 

analyzing said portion of sound data\o extract at least one sound feature from said 
portion of sound data; and \ 

assigning at least one haptic effect to said at least one sound feature, wherein said at least 
one haptic effect is commanded to said haptic feedback device approximately during said output 
of said portion of said sound to said user as audio, sara haptic effect causing a haptic sensation to 
be output to said user. \ 

22. A computer readable medium as recited in claim 21 wherein said analyzing said 
portion of said sound data includes processing said sound, data into a plurality of different 
frequency ranges and extracting said sound feature from each ot said frequency ranges. 
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23. A computer readable medium as recited in claim 22 wherein a haptic effect is 
associated with each of said frequency ranges if said sound feature is present in said frequency 
range. \ 

24. A computer readable medium as recited in claim 22 wherein said processing said 
sound data into a plurality of different frequency ranges includes applying a plurality of filters to 
said portion of souncldata. 

25. A computet readable medium as recited in claim 22 wherein said processing said 
sound data into a pluraliw of different frequency ranges includes using a fast Fourier transform 
(TFT). \ 

26. A computer readable medium as recited in claim 24 wherein each of said frequency 
ranges is associated with a different haptic sensation. 

27. A computer readabl^nedium as recited in claim 21 wherein said at least one haptic 
effect commanded to said haptic Yeedback device was previously mapped to said at least one 
sound feature. \ 



28. An apparatus for triggering naptic sensations from sound features detected in sound 
output from a computer, said haptic sensatWs able to be delivered to a user of a haptic feedback 
device in communication with said computeA the apparatus comprising: 

means for storing a portion of sound Mata that is output to a user as audio from an 
application program running on said computer, wherein said portion of sound data is stored in a 
memory buffer of said computer; \ 

means for analyzing said portion of sound daka using intelligent heuristics to extract at 
least one sound feature from said portion of sound data; Ynd 

means for triggering the execution of at least one Haptic effect based on said at least one 
sound feature, wherein said at least one haptic effect is Commanded to said haptic feedback 
device approximately correlated to said output of said portionNof sound data to said user as audio, 
said haptic effect causing a haptic sensation to be output to saidVser. 



Docket No. IMM142 



22 



